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Abstract 

In this paper we study optimal control problems for nonholonomic systems defined on Lie alge- 
broids by using quasi-velocities. We consider both kinematic, i.e. systems whose cost functional 
depends only on position and velocities, and dynamic optimal control problems, i.e. systems whose 
cost functional depends also on accelerations. The formulation of the problem directly at the level 
of Lie algebroids turns out to be the correct framework to explain in detail similar results appeared 



recently 



201 ] . We also provide several examples to illustrate our construction. 
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I. INTRODUCTION 



The principles of analytical mechanics established by D'Alembert, Lagrange, Gauss and 
Hamilton can also be contemplated from additional mathematical perspectives providing 
us methods for understanding Nature's law from new viewpoints which may be helpful in 
solving specific problems and clarifying the way in which Nature behaves. The traditional 
techniques were only applied to very simple models but current technology needs efficient 
algorithms in areas ranging from robotics to spacecraft design. Furthermore the computer 
development with the corresponding capability of computation suggests the convenience of 
analysing different formulations to yield the differential equations for multibody dynamics 
that involve a certain number of constraints. 

There exist different techniques to deal with such constrained systems. The geometric 
framework of manifolds replacing Euclidean spaces allows us to give a formulation for sys- 
tems with holonomic constraints in terms of generalised coordinates and free of Lagrange 
multipliers. However it is not clear how to choose generalised coordinates improving compu- 

or the Maggi equations formulation jg]. Another 



tational efficiency: Kane's method [14|, |15[ 
recent alternative formulation is given in 



13|- 



Nonholonomic constraints are very relevant and appear in many problems in physics and 
engineering, and in particular in control theory. Such nonholonomic constraints restrict 
possible virtual displacements and when taking into account such constraints d'Alembert- 

nfinn 

Lagrange principle leads to Boltzmann-Hamel equations [71. l9l. I2CH22]. 



The concept of quasi-velocity (or generalised velocity) (3| is of a great relevance in the 
study of mechanical systems, mainly in nonholonomic ones because the conditions of non- 
holonomic constraints can be expressed in a simpler form. Boltzmann-Hamel equations, 
Gibbs-Appell and Gauss principles, for instance, make use of quasi-coordinates (also called 
nonholonomic coordinates) and the Hamel symbols 16j. The use of quasi- velocities in the 
dynamics of nonholonomic system with symmetry has recently been investigated under 
different approaches in j^, QJs] and Hamel's equations have been recovered from this per- 
spective. 

It has been shown in recent papers 7, 8] that the appropriate geometric framework for 
studying systems with linear nonholonomic constraints is the framework of Lie algebroids. 
The geometric approach to mechanics uses tangent bundles in the Lagrangian formula- 



tion and tangent bundles are but particular instances of algebroids. The usual geometric 
approach to Lagrangian formalism was then developed in this extended framework of Lie 



algebroids 



BE 



1* 



24( the main advantage being that such structure arises in reduction 



processes from tangent bundles when the vertical endomorphism character is not projectable 



4(. The geometrical construction (see 17] ) is based on the generalization of the usual sym- 
plectic description of Lagrangian (or Hamiltonian) mechanics on tangent (or cotangent) 
bundles. The dynamics is then defined by a function of a Lie algebroid (for the Lagrangian 
formalism) or its dual (for the Hamiltonian one). Considering, for the sake of simplicity, 
only the Lagrangian case now, the solutions of the dynamics correspond to the analogue 
of the concept of SODE (considered as the section of the bundle T(TM) for a Lagrangian 
defined on TM). But in the Lie algebroid case the concept of second tangent bundle is 
subtle to define and the notion of prolongation of a Lie algebroid is necessary: 

Definition 1.1 Let (E, [ , ],p) be a Lie algebroid (r : E — > M) over a manifold M and 
v : P — >■ M be a fibration. For every point p G P we consider the vector space 

T p E P = { (b, v)eE x x T P P | p(b) = T p u(v) } , 

where Tv : TP — > TM is the tangent map to v and v(p) = x . The set T E P = U P ep T p E P 
has a natural vector bundle structure over P, the vector bundle projection r E being just the 
projection Tp(b,v) = Tp(v). 

The vector bundle r E : T E P — » P can be endowed with a Lie algebroid structure (see 
The Lie algebroid T E P is called the prolongation of v. P — >• M with respect to E 
or the E -tangent bundle to v . 

When we consider the case P = E, the resulting entension generalizes the notion of second 
tangent bundle to the Lie algebroid framework and the sections of this bundle represent the 
analogue of SODEs in the usual case. 

By using this notion, the symplectic formalism of Lagrangian systems in geometric me- 
chanics is easily extended to this more general setting. In a similar way, Hamiltonian me- 
chanics and discrete mechanics can be also generalized to the new framework. 

It is also well known from geometric control theory that many of the techniques of classical 
mechanics can be used in control theory 0, siQ]. The theory of Lie algebroids can be applied 
to deal with control problems and the application of such geometric tools is very useful for 



a better understanding of different control problems. This is our motivation for developing 
the theory of optimal control theory using the properties of Lie algebroid theory which is 
going to be the appropriate approach to Boltzmann-Hamel equations. 

Throughout the paper, we consider a Lie algebroid r : E — >■ M with anchor mapping 
p : E — >■ TM . When coordinates are required, we consider a local basis {x 1 } for the base 
manifold M, and a basis of sections {e a } for the bundle E which provides a set of coordinates 
(x l , y a ) for the Lie algebroid. The anchor mapping is then represented by the set of functions 
and the Lie algebra structure by the structure functions {C^a}- When considering the 
dual bundle E*, the dual basis of sections {e a } is chosen and the corresponding coordinates 
are denoted as (x\ p a ). The corresponding exterior differential d : Sec /\ k E* — > Sec f\ h+1 E* 
defines the corresponding algebroid cohomology, with respect to which the concept of sym- 
plectic or presymplectic form can be defined. This concept will be used later on when 
providing the geometrical framework for the maximum principle. 

Finally, we consider the coordinate functions for the extensions of the Lie algebroid E by 
a bundle P. We consider the general case although in practice we use only the case P = E 
and the case P = T> C E, for D a subbundle of the Lie algebroid. In any case, considering 
local coordinates (af , u 13 ) on P and a local basis {e Q } of sections of E, we can define a local 
basis {X Q , Vg} of sections of T E P by 



%a(p) = (p,e a (v(p)),p l a — J and V p {p) = (p,0 







d 

If z = (p,b,v) is an element of T E P, with b = z a e a , then v is of the form v = p l a z a -^— + 

ox 1 

d 

v^——r, and we can write z = z a X a (p) +v^V a(p). Vertical sections are linear combinations of 

{Va}. Analogously, when considering the dual object, T E P*, we use a local basis {X a , CP^}, 

/ d I 

where {Taj are the sections corresponding to the vertical elements 7p(p) = (p, 0, — — 

V Oh' /3 \ p 

for {(x l ,vp)} being a set of coordinates for the bundle P*. 



This article is organized in the following way. We address the interested reader to [7], [9|, 
for a detailed description of Lie algebroids and the construction of general optimal control 
systems. We provide a short review of those results in Sections [Til to [IV] while incorporating 
the formalism of quasi- velocities on them: Section [TTJ deals with the optimal control theory 



and the Pontryagin maximum principle 19|, kinematic optimal control is studied in Section 
III II and dynamical aspects are the aim on Section IIV1 The theory is illustrated in Section [V] 
with several examples. 



II. OPTIMAL CONTROL THEORY 



As it is well known, optimal control theory is a generalization of classical mechanics. The 
central result in the theory of optimal control systems is Pontryagin maximum principle. 
The reduction of optimal control problems can be performed within the framework of Lie 



algebroids, see 19]. This was done as in the case of classical mechanics, by introducing a 



general principle for any Lie algebroid and later studying the behavior under morphisms of 



Lie algebroids. See also ll| for a recent direct proof of Pontryagin principle in the context 
of general algebroids. 



Pontryagin maximum principle tin ] 



By a control system on a Lie algebroid r: E — > M with control space it: B — > M we 
mean a section of a : B — >• E along ir. A trajectory of the system a is an integral curve of 
the vector field p o a along tt. 



E — P -+TM 




Given a cost function L G C°°(B) we want to minimize the integral of L over some 
set of trajectories of the system satisfying some boundary conditions. Then we define the 
Hamiltonian function H G C°°(E* B) by H(fi, u) = (/i, &(u)) — L(u) and the associated 
Hamiltonian control system an (a section along pr x : E* x M B — > E* of T E E* ) defined on 
a subset of the manifold E* x m B, by means of the symplectic equation 

i aH n = dH, (2.1) 

where Q is the canonical symplectic form defined on the bundle E (i.e. a section of the 
bundle f\ 2 E* which is closed for the differential calculus defined on the Lie algebroid). The 
integral curves of the vector field p(<Jh) are said to be the critical trajectories. 

In the above expression, the meaning of i OH is as follows: Let $ : E — > E' be a morphism 
of the bundle T — y M over a map tp: M — > M' and let t] be a section of E' along tp. If 
bj a section of /\ p E'* then i v u is the section of /\ p l E* given by (i^w) m (ai, . . . , a p -i) = 
^^{n){jli. m )^ ^( a i)) • • • ) ^( a p-i)) f° r every m G M and ai, . . . , a p _i G E m . In our case, the 



map $ is the prolongation Tpr x : T E (E* x M B) — ^ T E E* of the map pr x : E* x M B — > E* 
(this last map fibered over the identity in M), and on is a section along pr x . Therefore, 
i^fi — dH is a section of the dual bundle to T E [E* Xm B). 

It is easy to see that the symplectic equation (12. ip has a unique solution defined on the 
following subset 

S H = { (fi, u)EE*x M B I ( dH(/i } u) , V ) = for all V G Ker Tpr 1 } . 

Therefore, it is necessary to perform a stabilization constraint algorithm to determine the 
submanifold where integral curves of an do exists. 

In local coordinates, the solution to the above symplectic equation is 



_ dH 

&H — T. q 



\d_E_ ^ 8H 

Pa dxl +th U aPQ 



dH 

defined on the subset where 7—7 = 0, and therefore the critical trajectories are the solution 

ou A 

of the differential-algebraic equations 



x = p «w« * 



dH ^ dH 



,. dH 



dH , . 



dH 

Notice that 7: — = a a . 
dfj, a 

One can easily see that whenever it is possible to write [i a = Pip % a then the above dif- 
ferential equations reduce to the critical equations for the control system Y = p(a) on TM 
and the function L. Nevertheless it is not warranted that fi is of that form. For instance 
in the case of a Lie algebra, the anchor vanishes, p = 0, so that the factorization p a = Pip l a 
will not be possible in general. 



III. KINEMATIC OPTIMAL CONTROL 

Let r : E — >■ M be a Lie algebroid and D a constraint distribution. Given a cost function 
k: E — y M, we consider the following kinematic optimal control problem: we can control 
directly all the (constrained) velocities, and we want to minimize some cost functional 



rP 

1(a) = / n(a(t)) dt, 

J a 



for a : [a, /3] C R — > E over the set of admissible curves taking values in D. We use coordi- 
nates (x l , y a ) to denote the elements of this bundle, where y a will represent the coordinates 

6 



with respect to some basis of section for D, as in the last section. We use capital indices 
A, B,C, . . . to represent the coordinates {y A , y B , . . .} corresponding to the elements of the 
fiber of E not contained in 2). Analogously, {fi A ,fi B , . . .} represent the coordinates for the 
fiber elements in E* not corresponding to sections dual to the elements in D. 

Remark 1 Whenever the cost function k is a quadratic function defined on T>, the problem 
that we are considering is just the problem of sub-Riemannian geometry. In the case of a 
degree 1 homogeneous cost function this is sub-Finslerian geometry, and in the more general 
case this problem can be called sub-Lagrangian problem. 

Since we can control directly the velocities or pseudovelocities, the control bundle is 
B = D and the system map a : D — > E is just the canonical inclusion a (a) = a. 

E — P -^TM 

cr / / 

D >- M 

Pontryagin Hamiltonian is a function H G C°°(E* x AI B) defined as H(fi,b) = (/j,,o~(b)) — 
which in coordinates reads 

H(x\ fi a , ha, u a ) = fi a u a - k(x\ u a ). (3.1) 
The Maximum principle imposes the choice of the control functions such that 

Under appropriate regularity conditions the set Sh of solutions of this equation is a sub- 
manifold of E* Xm B, which we call the critical submanifold. Frequently, this set is but the 
image of a section of E* Xm B — > E*, locally given by 

u a = u a (x,[i). (3.3) 

Thus the set Sh is diffeomorphic to E* and the optimal Hamiltonian, with local expression 
h)), defines via the canonical symplectic form a Hamiltonian system on E*. 
The restriction of the Pontryagin-Hamilton equations to this submanifold provides us 
with the control system 

# = p> a (3-4) 



and the dynamics of the momenta 



Ha = ~ 



dH 



B „,6 



(3.5) 
(3.6) 



These are the equations to be solved and to be used to determine, by using the mapping 



( 13. 3 p . the control functions defining the solution optimizing the value of the cost function. 

By substitution of u a = — — into these equations, and taking into account that -— — = — t~~, 

ou a ox 1 ox 1 



we get 



x l = p\u a - 



d f Ok \ dK dK b B b 

HA + HBC B Ab U b -p^ + ^C\ b U b - 



1 dx l du c 



(3.7) 



These equations are also obtained in 



20 



2l| for the case E = TM. 



Remark 2 For simplicity we are considering only normal extremals. For abnormal ex- 
tremals we just have to consider the Hamiltonian function to be H = \i a u a and solve the 
same equations, i.e. 



Ha = 0; 



x l = p l a u a ; 



pi B C* b u b = 0; fi A + /i B C> 6 = 0. 



B „,b 



{3.1 



with (fJ, A (t)) ^ (0) for all t. 



Remark 3 In the particular case when D = E and a = id^ we recover the Euler- Lagrange 
equations on the Lie algebroid E for the Lagrangian L = k. Also when D C E we get the 
so-called vakonomic equations for the Lagrangian L = k (see 



IV. DYNAMIC OPTIMAL CONTROL 

In the dynamic problem, we can control directly the motion on a nonholonomic system, 
with the exception of the constraint forces, of course. For instance, we can consider the 
equations of motion to be 8L{z)\<q = u, with u G T>* the control variables representing the 
external (generalized) forces acting on the system. Another possibility would be to consider 
systems on which the accelerations are the control variables. 

8 



In both kinds of problems the state space is the manifold D and the control bundle 
7T : B -> D is 



B = { (z, v) G T V D x D* | z G Adm(£) and 5L(z)\ v = v } . (4.1) 

An element (z, v) of B is of the form z = (a, a, v) with a G T> and u G T a 2) and where v is 
determined by the equations (u, b) = (5L(z), b) for every b G D. 

When we consider the forces as control variables, since we are assuming that the con- 
strained Lagrangian system is regular, we can identify B with pr x : D © T>* — > D, via 
(a,a,v;u) = (a, because the vector v is determined by the point a and the equation 
8L(z)\v = u. 

When we consider the accelerations as controls we can identify B with T DnAdm(£) — > 
D, via (a, a, v; v) = (a, a, v) because v is determined by v = SL(z)\-r>. 

From a formal point of view both problems are equivalent, since the relation between 
them is one-to-one and thus it is possible to use the optimal solution written in terms of 
accelerations to determine the optimal forces and viceversa. In other words, they are related 
by a feedback transformation. 

However, from the practical point of view the second problem produces simpler expres- 
sions. Therefore, we can identify B with T V D D Adm(E') and take coordinates (x\y a ,v a ) 
where v a are the acceleration coordinates, i.e. our control variables. 

On this set we also need to specify a control system where the optimization will be built. 

Such a system is specified by giving a section a : B — > T E D, i.e. the resulting system 

must always define an admissible velocity and acceleration. The Lie algebroid relevant for 

this case is the -E-tangent to D. An element of T E T> is of the form z = (a,b,w) with 

a G T>, b G E, with r(a) = r(b) and w G T a D with p(b) = Tt(w). Taking a local 

basis {e a } for T>, and completing a local basis {e a , e^} for E, we can write a = y a e a , 

d d 

b = z a e a + z A eA, and w = (p l a z a + p l A z A )-^— + w a -^-^. By taking coordinates (x 1 ) in the 

base, we have coordinates (x % , y a , z a , z A , w a ) on T E D. A local basis of sections of T E D — > T> 

is {X a , Xa, V a } and the element z can be written z = z a X a (x, y) + z a Xa(cl, y) + w a V a (a, y), 

d d 

and p 1 (z) = w = (p^z 0, + p\z A )-^— + w a -^—^. The corresponding coordinates on the dual 
bundle (T Er D)* will be denoted (x\ y a , p a , \xa, n a )- 

If we choose to control the accelerations of the system {u a }, the map a : B — > T E D is 

9 



given by the natural inclusion a(z) 



TV 




TV 



B 



which in coordinates corresponds to a(x l ,y a ,u a ) = (x l ,y a ,y a ,0,u a ). 

Given a cost function k, : B — > R we take the Pontryagin Hamiltonian H G C°°({T E T))* x 
B), defined as H(p,z) = (fi,a(z)) — k,(z) which in coordinates is 



H(x\ y a , fi a , fi A , vr a , u a ) = p a y a + 7r a u a - k(x\ y a , u a ^ 



where the control functions are the accelerations u a . 
dH 

From — — = 0, we get 

ou a 

These equations determine the optimal submanifold Sh in (T E T>)* B, which in this 

case is a section of the projection (T E D)* B — > B, locally given by the equations 

OH 

u a = u a (x % , y a , 7i a ). On Sh, the equations of motion are the following. From x = p— — , since 
in this case the base variables are (x, y), we get the original control system 



*' = p\v a + PaO = P \y a 



y a = u a . 



(4.3) 

— u a , because all the 

Q y a Q y a ^ 

structure functions involved vanish (i.e. V a commute with all the others). Therefore we get 



Also, the equations of motion for ir a , written as 7r a 



dH 8k 



Pa 



dn d ( dn 



dy a dt \ du 
which is the combination that appear in 



Ok 

Qya 



7Tn 



20J, equation (11), for the case E = TM, under 



the notation kj and without a justification. 
The equation of motion for [i a is 
dH 

~ Pa = Pa-Q-r + PcC C ab y b + p 

and the equation of motion for p A is 



-p l aQ-i + PcC c ah y b + PcC c ab y\ 



(4.4) 



dH 



Pa = Pat^ + PcC c Ab y b + p c C c Ah y h 



-p\Q- + p c C Ab y b + p c C c Ab y b . (4.5) 



These two last equations correspond to equations (18) and (19) obtained in [20( for the case 
E = TM. 
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Remark 4 As in the previous case, we have considered only normal extremals. For abnor- 
mal extremals we just have to take the cost function k = and solve the same equations for 
k = 0, that is 

/i a = 0; vr a = 0; = p\y a - (i B Cgy b = 0; fi A + fi B C% b y b = 0. (4.6) 

with (fiji(t)) 7^ (0) for all t. Interestingly, we get exactly the same equations (plus sx a = 0) 
as in the kinematic case. 



V. EXAMPLES 

First we discuss from the point of view of the theory of Lie algebroids an example studied 
in {21]. The result is naturally analogous to the results obtained there, but within the new 
framework the treatement of dynamical control systems becomes much more natural. After 
that, we study a few other examples of systems relevant for their applications and whose 
solutions, obtained in more involved ways, can be found in the literature. 



A. Dynamic optimal control of the vertical rolling disc 

For such a system, the state space manifold corresponds to M = M 2 x S 1 x S 1 , and we 
will use the coordinates x = (x x ,x 2 , x 3 , x 4 ), where x 1 = x, x 2 = y, x 3 = 8, and x A = <fi. 

The rolling without slipping condition of the motion on the plane leads to a pair of 
nonholonomic constraints 

x 1 — cos(x 4 )x 3 = and x 2 — sin(x 4 )x 3 = 0. 

We can define then a set of coordinates adapted to these constraints and write a set of 
coordinates {y} for the new velocities. Thus the quasi-velocities correspond to: 

y = x — cos(x Jar, y = x — sm{x Jar, y = x , y = x . 

Analogously the inverse transformation allows us to write: 



x 1 = y 1 + cos(x 4 )j/ 3 , x 2 = y 2 + sin(x 4 )?/ 3 , x 3 = y 3 , x A = y 4 



The local basis of sections of TM determined by the quasi-velocities turns out to be: 

d d 4 d . 4 d d d 

ei = Tr-r, e 2 = e 3 = cos(x ) — + sin(i )— + — , e 4 



dx 1 dx 2 dx 1 dx 2 dx 3 dx A 

11 



The Lie algebroid structure is the usual one for the tangent bundle. But in the basis above, 
the anchor mapping is written as: 

P(ei)= 5^' P(62) = ^' P(e3) = c ° s(x4) ^ + Sin(x4) ^ + ^' P(e4) = ^' 

The Lie algebra structure is obtained also as \e$, e 4 ] = sin(x )ej — cos(x 4 )e2, all other elements 
being zero. We can read then the Hamel symbols 7^0 in {3], Q] . 

In what regards the control part, we are considering a situation where we control the 
external forces in the directions of the admissible velocities. Thus, as the velocities on the 
constrained system are of the form 



y 1 = y 2 = 0, y 3 = x 3 and y 4 = x 



the natural coordinates are a = (x 1 , x 2 , x 3 , x 4 , y 3 , y 4 ) = (x,y a ). The control bundle B 
becomes thus T> © D* and we take as coordinates (x\ y 3 , y A , U3, U4), where U3 = |y 3 and 
u 4 = \y 4 for u a = (5L) a . 

The cost function corresponds to «(a, u) = \{u\ + u 2 ) and the control system is defined 

as: 

Q fj2 3 1 ,2 4 

•1 / 4\ • 3 -2 ■ / 4\ ■ 3 OUjX _l u, a 

x = cos(x )x , x = sm(x )x , u 3 = - — , u 4 = -— . 
The Pontryagin Hamiltonian H G C°°((T E D)* Xj B) corresponds now to 



H(&,p,u) = (p, cr a (n)) - «(a,u) = /i/y 7 + 717^ - -(«g + u 

with c 3 = 3/2 and c 4 = 1/4. 

The Maximum principle is encoded as 

dH 2 , dH 

— — = 113 = ,7T3 and — — = <^ ii 4 = 47r 4 , 

OU3 6 OUi 

and the Pontryagin equations (optimal dynamical control equations) correspond to: 

•1 / 4 \ 3 -2 • / 4 \ 3 ■ 3 3 -4 4 

x = cos(x )y , x = sm(x )y , x = y , x — y 
2 

2/ 3 = ^^3, ^ = 4U 4 , 7T 3 = -At3, ^"4 = -A*4, 
Ai = 0, /i 2 = 0, 
A3 = [-/iisin(x 4 ) + yU 2 cos(x 4 )]y 4 , /i 4 = [yUisin(x 4 ) - /i 2 cos(x 4 )]y 3 . 

12 



Since y 3 = x 3 , y 4 = x 4 and y 1 = uj, then /i 3 = — and /i 4 = — jq^§ ■ Thus, we can 
reduce the set of equations to: 

•1 / 4\ • S • 2 • / 4\ • 4 

x = cos(£ Jar, x = sm{x )x , 
d 4 x S 4 

— = -[/i!sin(x 4 ) -/i 2 cos(x 4 )]x 4 , 
cfc^x 

-rj = 16[— /iisin(x ) + /j,2Cos(x )}x 3 , 

CliL 

where pii, p>2 are constants. 



B. Optimal control problems of rotational motion of the free rigid body 

Consider the problem of rotational motion of the free rigid body. As configuration man- 
ifold we take the Lie group 5*0(3) and choose the type-I Euler angles ( X - X - X 1 3jS local 
coordinate system. We consider the canonical Lie algebroid structure of the tangent bundle 
TS0(3), whose anchor map is p = id TS o(3)- Let {ei,e 2 ,e 3 } be the set of sections for the 
bundle 



t\ = sec (x 2 ) sin (or 1 )-— - + cosfo; 3 )—- - + tan(x 2 )sin(x 3 )- 



dx 1 dx 2 dx 3 



e 2 = sec(x 2 )cos(a; 3 )7— — sin(;c 3 )— — - + tan(x 2 )cos(x 3 ' 1 



Ox 1 Ox 2 Ox 3 



63 Ox 3 ' 

whose Lie algebra structure is determined by the relations [ei, e 2 ] = e 3 , [e 2 , e 3 ] = e±, [e 3 , e±] 
e 2 . The anchor and the Lie bracket are locally determined by the functions 



p\ = sec(a; 2 )sin(x 3 ), p 2 = cos(x 3 ), p\ = tan(x 2 )sin(x 3 ) 
p\ = sec (x 2 ) cos (x 3 ), p\ = — sin(x 3 ), p\ = tan(x 2 )cos(x 3 ) 
p\ = 0, p\ = 0, p\ = 1; 



and Cf 2 — —C21 — C 23 — — C 32 — C 31 — — C 2 3 — 1. 

We consider now the rigid body subject to the constraint i; 1 cos(a; 2 )sin(x 3 )-|-x 2 cos(x 3 ) = 0. 
This implies that the constraint distribution D is the 2-dimensional subbundle of TSO(3) 
generated by e 2 and e 3 . 

13 



1. Constrained kinematic problem 



Let us study the kinematic constrained system, i.e., the system with admissible velocities 
belonging to the subbundle T> C TSO(3) defined by the condition y 1 = 0. Thus the system 
is 

x = sec(x )cos(x )u , x = — sin(x )u , x = tan(x )cos(x )u + u , (5.1) 

The cost function corresponds to the energy provided by the controls k(x\u a ) = 
\ [l2(u 2 ) 2 + -^(w 3 ) 2 ]. The Hamiltonian in this case is written as 

H = fi 2 u 2 + fi 3 u 3 - l - [I 2 {u 2 f + J 3 (« 3 ) 2 ] . 

Optimality conditions defining the submanifold Sh given in ( 13. 2 p are fi 2 = hu 2 ; H3 = I3U 3 . 
Using the representation u 2 = u 2 (x, fi) and u 3 = u 3 (x, fi) for Sh, the equations (13 .5p become 
then the control system (15.11) together with 

fi 2 + yUi^ 3 = 0, /i 3 - /iiu 2 = 0, fi\ + (Is - I 2 )u 2 u 3 = 0. 

In the case of the completely symmetric rigid body we get fi 2 + fiiu 3 = 0; {13 — fiiu 2 = 
and /ii = 0, which are equivalent to the equations obtained by Sastry and Montgomery in 
23]. 

2. Constrained dynamic problem 

Finally let us study the case of dynamic control for the constrained system. From the 
geometrical point of view, the control bundle B corresponds to T V D D Adm(TSO(3)) and 
the system can be described as 

x 1 = sec(x 2 )cos(x 3 )y 2 , x 2 = — sm(x 3 )y 2 , (5.2) 
x 3 = tan(x 2 )cos(x 3 )y 2 + y 3 , y 2 = w 2 , y 3 = u 3 (5.3) 

We consider now as cost function, the restriction to T> of the cost function 

k{x\ y\ u«) = \ \(l 2 f(u 2 ) 2 + (hf(u 3 ) 2 + (h - h) 2 (y 2 ) 2 (y 3 ) 2 ] , 

where we assume that the control functions are the components of the admissible angular 
accelerations of our system u 2 = v 2 and u 3 = v 3 . 
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Optimality condition leads to the submanifold W denned as tt 2 = (I 2 ) 2 u 2 7r 3 = (I 3 ) 2 u 3 . 
Then W is defined by specifying u 2 = u 2 (x,y,ir) and u 3 = u 3 (x,y,ir). The motion on W 
corresponds then to the control system (15.21) and 

(MO 2 (MA 2 , 2 

7T2 = 2 ^2, 7T3 = 5 A*3, 1*2 + V>lV = 0, fa ~ HlV =0, 

Ai + /W - /^y 3 = 0, 

where Mi = (I3 — I 2 )y 2 y 3 is a torque on D. 

In the case of the completely symmetric rigid body we obtain 

^2 = -A*2, ^3 = — A*3, A2 + A*i2/ 3 = ° 5 A3 - A*iZ/ 2 = 0, /ii + /i 3 l/ 2 - l^2V 3 = 0. 



This system gives the following equations obtained by Crouch and Silva Leite in 10|, Ex. 
6.4, Case II 

d V 3 n A 3 . 2 n • d 2 y 3 2 d 2 y 2 3 



C. Systems with symmetry and constraints: quasi-coordinates for the Atiyah al- 
gebroid 

Consider a ball rolling without sliding on a fixed table (see Example 8.12 in Q). The 
configuration space is Q = M 2 x 50(3), where 50(3) is parameterized by the Eulerian angles 
9, and ip. In quasi-coordinates (x,y,9,(j),x/j,x,y,oj x ,Uy,u z ) the energy may be expressed 
by T = I [x 2 + y 2 + k 2 (u 2 + u 2 + u 2 )} , where , w y and o; z are the components of the angular 
velocity of the ball. 

The system is invariant under 50(3) transformations, and thus it is natural to consider 
the corresponding formulation on the Atiyah algebroid E = TQj 50(3) = TM 2 x M 3 . On 
that system we must still implement the nonholonomic constraint arising from the rolling- 
without-sliding conditions x l — ru 2 = and x 2 + ru\ = 0. 

For the configuration space we can choose coordinates M = Q/G = M 2 3 x = (x x ,x 2 ), 
with x 1 = x and x 2 = y. In what regards the fiber, we can choose thus a transformation 
mapping the set of fiber coordinates {x 1 , x 2 , u 3 , cji, u 2 } onto a new set {y a }. These quasi- 
velocities become then y % = x\ y 3 = u 3 , y A = x 1 — ru 2 , y 5 = x 2 + roj\. 
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Analogously we can consider the inverse transformation. Thus the original velocities can 
be written in terms of the quasi- velocities as 

x = y , w 3 = y , wi = — y + -y , u) 2 = -y -~y 

fy ly ry ry 

The local basis of sections of determined by the quasi-velocities turns out to be 

, 1 , , 1 , 1 1 , 

/i = e x + -e 4 , / 2 = e 2 e 3 , / 3 = e 5 , / 4 = — e 4 , / 5 = -e 3 

ry 7" f 7" 

where {e^, e' 2 , • • • , e' 5 } is the local basis defined in page 36. 

With respect to this basis, the structure constants and the anchor mapping of the Lie 
algebroid structure become 

L/2, fi] = [fi, /s] = [A, A] = L/5, A] = -^/3j 

[/3, /l] = [/4, ^3] = /5L/2, ^3] = 1/3, fe] = fi, 

p(h) = d x , p(f 2 ) = d y , 

the remaining elements being zero. 

The set of admissible velocities becomes thus the fiber of the distribution T>, which 
corresponds to D = {(x l ,y a ) G E \ y 4 = y 5 = 0}. The coordinates for these points are 
therefore a = (a; 1 , x 2 , y l , y 2 , y 3 ) = (x l ,y a ), where in terms of the original set of coordinates 
these correspond to y 1 = x 1 = u 1 , y 2 = x 2 = u 2 , y 3 = U3 = u 3 and y A = = y 5 . 

The dynamical system on the algebroid is defined by a Lagrangian function on E, which 
can be written in terms of the velocities as L(x, y, x, y, cui, u>2, 0J3) = \ [x 2 + y 2 + k 2 (uf + oj 2 + 
oo 2 )}, and in terms of the quasi-velocities 

L(x\y a )= 1 -[(y 1 ) 2 + (y 2 ) 2 + 

k 2 r- 2 {{y') 2 + (y 2 ) 2 + (y 4 ) 2 + (y 5 ) 2 - y 2 y 5 ~ vV) + W) 2 ] . (5.4) 

1. Kinematic Control Problem 

Consider the following problem: determine the minimal value among the set of admis- 
sible solutions a : R — > E, of the controlled Euler-Lagrange equations of the form 5L(a(t)) = 
0, a(t) G D, where the cost fuction is k(x\ u a ) = \ { (u 1 ) 2 + (u 2 ) 2 + J \{u 2 ) 2 + (V ) 2 ] + k 2 {u 3 ) 
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The control bundle is 2), and the section we consider a : (x l ,u a ) G D — > (x l ,u a ,0,u a ) G E 
is the canonical inclusion. Please notice that we use the notation u a to denote the elements 
of the fiber of D when considered as the control bundle. 

The Pontryagin Hamiltonian is then written as a function H G C°°(E* Xjr2 D). The 
optimality conditions of the Maximum principle on this function imply 

dH , , 

— = n a = c a u a , 5.5 

where C\ = c 2 = 1 + k 2 /r 2 and c 3 = k 2 . 

If we write the set of Pontryagin equations we see: 

■i i ■ ^2,^3. Ms Hi 
X = V, /il = /i 3 n+H5 — , ^2 = M 3 o' 

c 2 r l c 3 c 3 c x r 2 

Ml , ^2 . /i2 /i3 ^3 . Ml 
^3— — M5 r /^4 — , M4 — — ^3 9 — M5 — j M5 — M4 r /i 3 n- 

Thus we can use ( 15. 5 p and the above equations to define the resulting system on D: 

f]2 1 1 J2 2 . , 

— = — {d 2 u 3 - x L03), — = — (x u 3 - diu 3 ), uj 3 = —(d 1 x - d 2 x ), 
at z c\ at z c 2 c 3 

with d\, d 2 constants and C\ = c 2 = 1 + k 2 /r 2 and c 3 = k 2 . 



2. Dynamic Optimal Control Problem 

Let us consider now a different control problem, where we are able to control the forces 
acting on the system, i.e. we consider a system corresponding to (SL) a = u a , where L is 
defined as (15 .4p and 5 represents the variational derivative. In this case, for the Lagrangian 
given above, this implies that y a = — , a = 1,2,3; where again c\ = c 2 = 1 + k 2 /r 2 and 

). 

The control system is thus defined as a section a : (x l , y a , u a ) G 2)©D* H- (x\ y a , y a , 0, u a j c a ) G 
T Er D. The cost function now is the energy provided by the control functions: K,(x\u a ) = 
\Tla u 'a- As a resu lt> the Pontryagin Hamiltonian H G C 00 ((1~ E T>)* Xj B) reads now 
H(x l , y a , fi a , ii a , u a ) = fi a y a + ^a^- — ^J2 a u a- The maximum principle applied to this 
function results 

— — = u a = — , with a = 1, 2, 3. 

ou a c a 
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Then the optimal manifold correponds to this submanifold of (T E D)* B. 
The Pontryagin equations on (T E D)* x D B are: 



X = V , y = — , 7Ta = ~lla 

C a 

2 1 

An = a*3— ^ + V5y 3 , h = -^y 3 - At3-s-, A3 = -/W + 

fl4 = —ft>l, ^5 = — ^2- 

But if we restrict them to the optimized submanifold we obtain the reduced system: 



d^x 1 c 3 2 2 d 2 u d 3 x 2 e 2 

~a¥ = W X 'd¥,~ u ^ ~^ 3 ' 

d^x 2 c 3 2 1 d 2 co d 3 x 1 e\ 

~d¥ = ~W x ^ 3 + U3 ^ + ^ U3 ' 

d 3 co 3 _ c 2 2 . 1 d 3 x 2 ci 2 . 2 d 3 x 1 e 2 . x e x . 2 

~dF ~ W x ~d¥ ~ W x ~d¥ + 4 X ~ qf ' 

where c\ = c 2 = 1 + k 2 /r 2 , C3 = k 2 and ei, e 2 are arbitrary constants. 
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